Deformable Shape-From-Motion in Laparoscopy using a Rigid Sliding Window
نویسندگان
چکیده
We present an approach for deformable 3D surface reconstruction using laparoscopic monocular video data that is based on breaking down the nonrigid reconstruction problem into a sequence of temporally-localised rigid reconstructions. Our main contribution, the Rigid Sliding Window algorithm provides a means to achieve this whereby Rigid Shapefrom-Motion is performed over a sliding window that adapts according to the amount of deformation detected in the scene. Our method is particularly applicable for laparoscopy, where, by adapting the window, it can exploit low-frequency deformations caused by for example breathing. Our algorithm is demonstrated on both synthetic and in-vivo image sequences.
منابع مشابه
Template-Based Conformal Shape-from-Motion-and-Shading for Laparoscopy
Shape-from-Shading (SfS) is one of the fundamental techniques to recover depth from a single view. Such a method has shown encouraging but limited results in laparoscopic surgery due to the complex reflectance properties of the organ tissues. On the other hand, Template-Based Deformable-Shape-from-Motion (DSfM) has been recently used to recover a coarse 3D shape in laparoscopy. We propose to co...
متن کاملMotion-based mesh segmentation using augmented silhouettes
Motion-based segmentation, the problem of detecting rigid parts of an articulated three-dimensional shape, is an open challenge that has several applications in mesh animation, compression, and interpolation. We present a novel approach that uses the visual perception of the shape and its motion to distinguish the rigid from the deformable parts of the object. Using twodimensional projections o...
متن کاملOnline Dense Non-Rigid 3D Shape and Camera Motion Recovery
This paper describes a sequential solution to dense non-rigid structure from motion that recovers the camera motion and 3D shape of non-rigid objects by processing a monocular image sequence as the data arrives. We propose to model the time-varying shape with a probabilistic linear subspace of mode shapes obtained from continuum mechanics. To efficiently encode the deformations of dense 3D shap...
متن کاملSequential Non-Rigid Structure-from-Motion with the 3D-Implicit Low-Rank Shape Model
So far the Non-Rigid Structure-from-Motion problem has been tackled using a batch approach. All the frames are processed at once after the video acquisition takes place. In this paper we propose an incremental approach to the estimation of deformable models. Image frames are processed online in a sequential fashion. The shape is initialised to a rigid model from the first few frames. Subsequent...
متن کاملNon-rigid Structure from Motion using Quadratic Deformation Models
Reconstructing a 3D deformable surface from a set of 2D correspondences across an image sequence is the problem known as Non-Rigid Structure from Motion (NRSfM). In this scenario, it is usually assumed that the 3D deformable shape can be represented by a combination of rigid basis shapes with time varying coefficients. Due to its simplicity, linear basis shape models have provided good reconstr...
متن کامل